A Quaternion Gated Recurrent Unit Neural Network for Sensor Fusion
نویسندگان
چکیده
Recurrent Neural Networks (RNNs) are known for their ability to learn relationships within temporal sequences. Gated Unit (GRU) networks have found use in challenging time-dependent applications such as Natural Language Processing (NLP), financial analysis and sensor fusion due capability cope with the vanishing gradient problem. GRUs also be more computationally efficient than variant, Long Short-Term Memory neural network (LSTM), less complex structure such, suitable requiring management of computational resources. Many require a stronger mapping features further enhance prediction accuracy. A novel Quaternion (QGRU) is proposed this paper, which leverages internal external dependencies quaternion algebra map correlations across multidimensional features. The QGRU can used efficiently capture inter- intra-dependencies unlike GRU, only captures sequence. Furthermore, performance method evaluated on problem involving navigation Global Navigation Satellite System (GNSS) deprived environments well human activity recognition results obtained show that produces competitive almost 3.7 times fewer parameters compared GRU. code available at.
منابع مشابه
Minimal Gated Unit for Recurrent Neural Networks
Recently recurrent neural networks (RNN) has been very successful in handling sequence data. However, understanding RNN and finding the best practices for RNN is a difficult task, partly because there are many competing and complex hidden units (such as LSTM and GRU). We propose a gated unit for RNN, named as Minimal Gated Unit (MGU), since it only contains one gate, which is a minimal design a...
متن کاملGated Recurrent Convolution Neural Network for OCR
Optical Character Recognition (OCR) aims to recognize text in natural images. Inspired by a recently proposed model for general image classification, Recurrent Convolution Neural Network (RCNN), we propose a new architecture named Gated RCNN (GRCNN) for solving this problem. Its critical component, Gated Recurrent Convolution Layer (GRCL), is constructed by adding a gate to the Recurrent Convol...
متن کاملA Recurrent Neural Network Model for Solving Linear Semidefinite Programming
In this paper we solve a wide rang of Semidefinite Programming (SDP) Problem by using Recurrent Neural Networks (RNNs). SDP is an important numerical tool for analysis and synthesis in systems and control theory. First we reformulate the problem to a linear programming problem, second we reformulate it to a first order system of ordinary differential equations. Then a recurrent neural network...
متن کاملMulti-level Gated Recurrent Neural Network for dialog act classification
In this paper we focus on the problem of dialog act (DA) labelling. This problem has recently attracted a lot of attention as it is an important sub-part of an automatic dialog model, which is currently in great demand. Traditional methods tend to see this problem as a sequence labelling task and deal with it by applying classifiers with rich features. Most of the current neural network models ...
متن کاملDocument Modeling with Gated Recurrent Neural Network for Sentiment Classification
Document level sentiment classification remains a challenge: encoding the intrinsic relations between sentences in the semantic meaning of a document. To address this, we introduce a neural network model to learn vector-based document representation in a unified, bottom-up fashion. The model first learns sentence representation with convolutional neural network or long short-term memory. Afterw...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Information
سال: 2021
ISSN: ['2078-2489']
DOI: https://doi.org/10.3390/info12030117